More info (and a video) here!

I've been working for a while on a tool for dancers to experiment with movement sensors, sound and light control, and live projection.

So, as the whole projection part relies on Processing 3.2.1, and third party developers can easily build plug-ins (almost the same way they write Processing sketches) which can be imported from the UI, I thought it would be appropriate to share it here, just in case someone is looking for something for his/her interactive artwork, kinect based game development, interactive musical interface development, or anything...

www.marineframework.org

I'm still improving the core module and UI module, so new ideas and suggestions are always welcome!

Hope you enjoy it!

• Call for Works -

Residency opportunity between Mai to June 2017 at the Institute for Computer Music and Sound Technology of the Zurich University of the Arts.

We are looking for European artist(s) interested in creating a new work in and for the Immersive Lab. The residency offers the opportunity to realise a real-time interactive audio-visual piece that leverages the unique combination of 360 degree sound & video projection and touch-based interaction.

The main goal of the Immersive Lab lies in the presentation of abstract, algorithmic, generative media works that place a strong focus on interaction, immersion and perception. However, we don't support works that represent pure game concepts or fixed-media pieces. Other than that, there are no limitations with respect to the content of the proposed work.

The artist(s) should possess both the technical and artistic expertise in the media-arts domains of audio, video/graphics and interaction. If necessary and artistically compelling, we can also accommodate a team of two artists, whose combined expertise meets these requirements (e.g. a collaboration between sound and visual artists). Our team will provide conceptual guidance and technical support but will not aid in content creation or provide software programming services.

The installation software runs under OS X and is built in a modular fashion. This provides the flexibility to easily integrate a variety of real-time software components for content generation. The touch detection system provides tracking information via OSC in the 'tuio' format. The projection on the cylinder via a video-mapping system is based on the Syphon context-sharing technique. Multichannel audio is directly output to the installation's audio interface.

The goal of the residency is to deliver a finished piece, which becomes a permanent part of the catalogue of works of the Immersive Lab and can be shown in public exhibitions. The piece should run unattended and be maintained in running condition for a period of at least two years.

Ideally, the residency has a duration of two weeks and falls into the timespan between 1. Mai and 30. June 2017. Accommodation and per diems are covered. All other expenses must to be covered by the artist(s).

Applicants should hand in the submission form, containing a CV, an artist statement and a detailed proposal for work no later than the 31. March 2017. Notification of selection will be given on 14. April.

For more information concerning the Immersive Lab see http//immersivelab.zhdk.ch.

Description:

The 'Immersive Lab' is a media space that integrates panoramic video, surround audio with full touch interaction where the entire screen serves as touch surface. The 'Immersive Lab' provides a platform for a catalogue of artistic works that are specifically tailored to the unique situation that this configuration offers. These works articulate the relationship between immersive media and direct interaction. It functions both as a space for experimental learning and creation and as a permanent audiovisual installation for the general public, showing finished pieces in a self-explanatory way.

This installation as a platform is the fruit of several years of investigation, artistic creation, serving for research projects, workshops and residencies. The term Immersion is used in a broader sense. Apart from spatial envelopment by image and sound, additional levels of immersions are generated for the visitors: they enter into a dedicated physical space, direct tactile interaction on the panoramic surface enhances their personal engagement, and finally within the shared space arise group behaviour and social interactions. Such an extended form of immersion provides a multi-faceted experience.

The compositions can be collaboratively created and combine visual and sonic material with generative and algorithmic methods. The artistic approach focuses on real-time pieces that react to visitor interaction and that take advantage of the panoramic nature of the installation.

Different forms of engagement are possible within the installation. The audience can freely explore the works and experience different types of perceptions. Artists can experiment with the development of compositional strategies for working with different senses and artistic domains. The installation exposes foundational aspects of immersion such as spatial and multi-sensory perception, which provide interesting topics for investigation.

Work in the 'Immersive Lab' happens in different phases, activities, and addresses different people. In a teaching context, in general, any student can visit the lab in guided tours. Students majoring in electronic music or media arts, however, are invited to actively learn by exploring the inner workings if existing pieces. Artists and advanced students have the opportunity to become involved more intensely by creating entirely new pieces. For this, the ICST offers to share its experience, methods, and tools for development and realization of ideas for this particular media space. Finally, in the exhibition context, general audiences are invited to experience the catalogue of works.

Thank you very much !

Arduino :

#include <NewPing.h>
#include <Servo.h>


#define TRIGGER_PIN  12  // Arduino pin tied to trigger pin on the ultrasonic sensor.
#define ECHO_PIN     11  // Arduino pin tied to echo pin on the ultrasonic sensor.
#define MAX_DISTANCE 200 // Maximum distance we want to ping for (in centimeters). Maximum sensor distance is rated at 400-500cm.

int LEDpin = 13;
Servo myservo;
int val;

NewPing sonar(TRIGGER_PIN, ECHO_PIN, MAX_DISTANCE); // NewPing setup of pins and maximum distance.

void setup() {
  Serial.begin(9600); // Open serial monitor at 115200 baud to see ping results.
  pinMode(LEDpin, OUTPUT);
  myservo.attach(9);// attaches servo to pin 9

}

void loop() {
  delay(400);                      // Wait 50ms between pings (about 20 pings/sec). 29ms should be the shortest delay between pings.
  unsigned int uS = sonar.ping(); // Send ping, get ping time in microseconds (uS).
  //Serial.print("Ping: ");
  Serial.println(uS / US_ROUNDTRIP_CM); // Convert ping time to distance in cm and print result (0 = outside set distance range)
  //Serial.println("cm");
  //if(uS / US_ROUNDTRIP_CM < 100) {digitalWrite(LEDpin, HIGH);}
  //else if (uS / US_ROUNDTRIP_CM > 100) {digitalWrite(LEDpin, LOW);}
 // else if (uS / US_ROUNDTRIP_CM > 100) {digitalWrite(LEDpin, LOW);}
  //delay (200);

  val = (uS / US_ROUNDTRIP_CM);
  val = map(val, 0, 172, 15, 180);
  myservo.write(val);
  delay (150);


}

PROCESSING

import gab.opencv.*;
import processing.video.*;
import java.awt.*;
//-------------------------------------------------
/*


*/
//-------------------------------------------------
Capture video;
OpenCV opencv;
//---
Movie monSuperFilm;// déclaration du film
float positionDuFilmEnSecondes;//position ds le film
Integer surfaceVisages,surfaceMin,surfaceMax;
//-------------------------------------------------
/*


*/
//-------------------------------------------------
void setup() {
  //----------------
  size(1080, 720);//dimensions de votre film en pixels; mettre la définition de votre film
  //-----------------
  // partie video cam
  //-----------------
  video = new Capture(this, 640/2, 480/2);
  opencv = new OpenCV(this, 640/2, 480/2);
  opencv.loadCascade(OpenCV.CASCADE_FRONTALFACE);  
  video.start();
  //-----------------
  // partie film
  //-----------------
    monSuperFilm = new Movie(this,"pattern1080-6low-1.mov");// chargement du film ; mettre le nom de votre film qui est dans le dossier data
    monSuperFilm.loop();
  //-----------------
  // partie visages
  //-----------------
  // plus la surface du visage est grande dans l'image retournée par la caméra du mac et plus on est près
  // le programme cumule les surfaces de tous les visages capturés par la caméra; à essayer à plusieurs devant le mac !
    surfaceMin=400;// min 0 //surface du visage sur la camera qui correspond au début du film
    surfaceMax=1500;// max 640x480=307200 //surface du visage sur la camera qui correspond à la fin du film
}
//-------------------------------------------------
/*


*/
//-------------------------------------------------
void draw() {
  //background(255);
  //scale(2);
  opencv.loadImage(video);

  //image(video, 0, 0 );

  //noFill();
  stroke(0, 255, 0);
  strokeWeight(3);
  Rectangle[] faces = opencv.detect();
  println(faces.length);
//---------------------------------------------
// calcul de la surface occupée par les visages
//---------------------------------------------
surfaceVisages=0;
  for (int i = 0; i < faces.length; i++) {
    //println(faces[i].x + "," + faces[i].y);
    //rect(faces[i].x, faces[i].y, faces[i].width, faces[i].height);
    surfaceVisages=surfaceVisages+faces[i].width*faces[i].height;
  }
  fill(0);
  text(str(surfaceMin)+" / "+str(surfaceVisages)+" / "+str(surfaceMax),10,50);
   monSuperFilm.read();//on lit l'image du film 
  positionDuFilmEnSecondes=map(surfaceVisages,surfaceMin,surfaceMax,0,monSuperFilm.duration()); 
  monSuperFilm.jump(positionDuFilmEnSecondes);// on se déplace dans le film
  image(monSuperFilm, 0, 0);//on affiche l'image courante du film

}
//-------------------------------------------------
/*


*/
//-------------------------------------------------
void captureEvent(Capture c) {
  c.read();
}

// it's my failure try:/

        PFont font;


        void setup () {
          size (600, 600);
          background (0);
          smooth (10);
          noStroke ();
          font=loadFont ("HelveticaNeue-BlackCond-48.vlw");
          textFont (font);
          strokeWeight(1);
          stroke(250, 100);
        }

        void draw () {
          text("G", pmouseX+30, pmouseY);
          text("M", pmouseX, pmouseY);
          text("F", pmouseX, pmouseY-30);
          fill(random(0, 255));
        }

I would like to share with you our last piece "Non-Finito", an interactive installation creating a 3D marble sculpture from users who enter into a kinect field of view. We use the kinect v2 library and GLSL Shader for materials and generative marble texture.

We hope you wil like it.

Non-Finito : http://www.bonjour-lab.com/project/non-finito/

You wan also see some making of still here : https://www.flickr.com/photos/alexr4/sets/72157666351804994

The course approaches computer vision from an introductory level and basic experience in any programming language/platform is encouraged.

An application period is open now and it is suggested to apply sooner as maximum amount of participants is only 15! Find more about the course here.

Instructor - Chris Sugrue.

Organised by School of Machines - Making & Make Believe.